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PATENT 



DETERMINING LOCATION INFORMATION FOR A NODE IN A NETWORK 
USING AT LEAST ONE LOCAL LANDMARK NODE 

TECHNICAL FIELD 

This invention relates generally to networks. More particularly, the invention 

relates to determining location information for a node in a network. 
BACKGROUND 

The Internet, as it has grown considerably in size and popularity, is being used to 
provide various services and applications to users. Diverse applications, such as 
streaming a short movie demonstrating how to assemble a piece of furniture, taking a 
virtual tour of a real estate property or a scenic spot, watching a live performance of an 
artist, and participating in a networked multi-user computer game or conference, are all 
available to users via the Internet. 

An important trend is that users are no longer satisfied with receiving services that 
are targeted at mass audiences. Users are demanding services that are tailored to their 
individual needs. With the proliferation of personalized services, an important challenge 
facing future network infrastructure is balancing the tradeoffs between providing 
individualized services to each user and making efficient use of network resources. 

A fundamental challenge in effectively utilizing network resources and services is 
efficiently and quickly locating desired resources/services in large networks, such as the 
Internet. For example, a user may generate a query for finding particular media content 
available in the network. Location and distance estimation techniques may be used to find 
the closest cache or proxy in the network that provides the desired data or service, such as 
the desired media content. 
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Landmark clustering is a known location and distance estimation technique for 
determining a distance to a node in a network. Landmark clustering was introduced for 
routing in large networks. A node's physical location in a network is estimated by 
determining the node's distance to a common set of landmark nodes in the network. 
5 Landmark clustering assumes that if two nodes have similar distances (e.g., measured 
latencies) to the landmark nodes, the two nodes are likely to be close to each other. 
Routers store the estimated physical locations of the nodes and use the position 
information for routing to the closest node. 

Figure 8 illustrates estimating physical locations for the nodes 810 and 820 in the 
10 network 800 using landmark clustering. The client nodes 810 and 820 determine their 
distances to the landmark nodes L801 and L802. Because the nodes 810 and 820 have 
similar distances to the landmark nodes L801 and L802, the nodes 810 and 820 are 
determined to be close to each other. 

Landmark clustering is an efficient technique for determining general locations for 
15 nodes in a network. However, current landmark clustering techniques tend to result in 

false clustering, where nodes that are far away in network distance are clustered near each 
other. That is nodes that are far away from landmark nodes tend be estimated as having 
locations near each other when in fact they are located at substantial distances from each 
other. Secondly, landmark clustering is a coarse-grained approximation and is not 
20 effective in differentiating between nodes that are relatively close in distance. 

HP Docket No. 200314632-1 

2 



SUMMARY OF THE EMBODIMENTS OF THE INVENTION 

According to an embodiment, a method of determining location information for a 
node in a network includes determining a first distance from the node to at least one global 
landmark node and determining a second distance from the node to at least one local 
5 landmark node. The local landmark node may be proximally located to the node. The 
method also includes determining location information for the node based on the first distance 
and the second distance. 

According to another embodiment, a node in a network includes means for 
determining a first distance from the node to at least one global landmark node and means for 
10 determining a second distance from the node to at least one local landmark node. The local 
landmark node may be proximally located to the node and the at least one global landmark 
node. The node also includes means for determining location information for the node based 
on the first distance and the second distance. 

According to yet another embodiment, a computer system is operable to connect to a 
15 peer-to-peer network. The computer system includes a processor operable to determine a 
physical location of the computer system in the peer-to-peer network by determining 
distances to at least one global landmark node and at least one local landmark node. The 
local landmark may be proximally located to the computer system in the peer-to-peer 
network. The computer system may also include a memory operable to store location 
20 information associated with the physical location for the computer system. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Various features of the embodiments can be more fully appreciated, as the same 
become better understood with reference to the following detailed description of the 
embodiments when considered in connection with the accompanying figures, in which: 

Figure 1 illustrates using global landmark nodes and local landmark nodes in a 
network to generate location information according to an embodiment; 

Figure 2 illustrates a 2-dimensional CAN overlay network for the network shown 
in figure 1, according to an embodiment; 

Figure 3 illustrates a landmark space including landmark vectors, according to an 
embodiment; 

Figure 4 illustrates using a hash function to translate points in the landmark space 
shown in figure 3 to an overlay network, such as shown in figure 2, according to an 
embodiment; 

Figure 5 illustrates a flow chart of a method for determining location information 
for a node in a network, according to an embodiment; 

Figure 6 illustrates a peer-to-peer system, according to an embodiment; 

Figure 7 illustrates a computer system that may operate as a node in the peer-to- 
peer system shown in figure 6, according to an embodiment; and 

Figure 8 illustrates a conventional landmark clustering scheme. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

For simplicity and illustrative purposes, the principles of the embodiments are 

described. However, one of ordinary skill in the art would readily recognize that the same 

HP Docket No. 200314632-1 



principles are equally applicable to, and can be implemented in, all types of network 
systems, and that any such variations do not depart from the true spirit and scope of the 
embodiments of the invention. Moreover, in the following detailed description, references 
are made to the accompanying figures, which illustrate specific embodiments. Electrical, 
mechanical, logical and structural changes may be made to the embodiments without 
departing from the spirit and scope of the embodiments of the invention. 

According to an embodiment, an enhanced landmark clustering technique is used 
to estimate physical locations of nodes in a network. A node is any device that may send 
and/or receive messages from another device via the network. A physical location of a 
node, also referred to herein as the node's location in the network, is the node's location in 
the network relative to other nodes in the network. For example, location information for 
the node may be determined by measuring distances to other nodes in the network, such as 
global landmark nodes and local landmark nodes that are proximally located to the node. 
The location information may be used as an estimation of the node's physical location in 
the network. Distance to a node, for example, may be measured using a network metric 
such as round-trip-time or network hops. Distances between nodes and location 
information for nodes may not be the same as geographical distances between nodes and 
geographical locations of the nodes, because distances are measured in terms of a network 
metric, such as round-trip-time or network hops, and are not measured in terms of a 
geographical distance metric, such as kilometers or miles. 

Global landmark nodes and local landmark nodes may be randomly selected from 
the nodes in a network. Almost any node in the network may be selected to be a global 
landmark node or a local landmark node. The number of nodes selected to be local 
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landmark nodes and global landmark nodes is generally much smaller than the total 
number of nodes in the network. Also, the total number of global landmark nodes in the 
network is generally smaller than the number of local landmark nodes. The number of 
global and local landmark nodes used in the network may depend on the desired accuracy 
5 of the location information. To minimize network traffic local landmark nodes may be 
strategically placed in the network, such as near gateway routers. For example, routers 
encountered by a message from the node en route to a global landmark can be used as 
local landmark nodes. 

As described above, location information for a node may be determined by 

10 measuring distances to global landmark nodes and local landmark nodes that are 

proximally located to the node. In one embodiment, the node measures distances to each 
of the global landmark nodes and the proximally located local landmark nodes in the 
network to determine the node's location information. In one example, a proximally 
located local landmark mark node is generally closer to the node than at least one of the 

15 global landmark nodes. For example, a local landmark node may be on a routing path 
between the node and a global landmark node. In this example, the distance to the local 
landmark nodes can be obtained with little or no added messaging overhead if these local 
landmark nodes can respond to measurement traffic, such as a probe packet for measuring 
round-trip-time. That is additional distance measurement traffic to the local landmark 

20 nodes need not be generated, because this example may utilize a probe packet being 
transmitted to a global landmark node to measure distances to local landmark nodes 
encountered en route to the global landmark node. In another example, a local landmark 
node may be proximally located to a node if the local landmark node is within a 
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predetermined distance to the node. In this example, a node may identify local landmark 
nodes in proximity to the node using a global information table, and then measure 
distances to the identified local landmark nodes. Thus, local landmark nodes, which may 
not be on a routing path to a global landmark node but which may still be useful for 
accurately determining location information for the node, can be used. 

Location information may be generated for substantially all the nodes in a network. 
The location information may be used for a variety of applications. For example, the 
location information may be used to identify a node for routing in the network. In another 
example, the location information may be used to find a closest node providing desired 
content or services for a user. 

Compared with conventional landmark clustering techniques, the landmark 
technique according to embodiments of the invention a physical location of a node can be 
accurately estimated by determining distances to a relatively small number of global and 
local landmark nodes. Also, the local landmark nodes provide accurate information of the 
local network characteristics. Thus, optimal paths for routing based on local network 
characteristics may be selected. 

Figure 1 illustrates an example of using global landmark nodes and local landmark 
nodes in a network to generate location information. Location information is generated for 
nodes 10 and 20 in the network 100 by measuring distance to global landmark nodes and 
local landmark nodes in proximity to the nodes 10 and 20. For example, for node 10 
distances are measured to the global landmarks GL1 and GL2. Distances are also measured 
to the local landmark nodes LL1 and LL2. Distance to a node may be measured using a 
known network metric, such as round-trip-time (RTT) or network hops. For example, the 
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node lOmaytransmitaprobe packet to the global landmark node GL 1 and measure RTTof 
the probe packet to determine the distance to the global landmark node GL1 . A probe packet, 
for example, is a packet generated by node to measure one or more predetermined network 
metrics, such as RTT. 

A landmark vector representing the location information for the node 10 is generated 
including the distances to the global landmark nodes GL1 and GL2 and the local landmark 
nodes LL1 and LL4. The landmark vector for the node 10 may be represented as <d(n, GL1), 
d(n, LL1), d(n, GL2), d(n, LL4)>, where d is the distance between the nodes and n represents 
the node for which location information is being generated. 

Similarly, location information may be generated for the node 20. For example, 
distances are measured to the global landmarks GL1 and GL2. Distances are also measured 
to the local landmark nodes LL2 and LL3. A landmark vector representing the location 
information for the node 20 is generated including the distances to the global landmark nodes 
GL1 and GL2 and the local landmark nodes LL2 and LL3. The landmark vector for the node 
20 may be represented as <d(n, GL1), d(n, LL2), d(n, GL2), d(n, LL3)>. 

A location estimation technique that only considers distance to the global landmarks 
GL1 and GL2 may conclude that nodes 10 and 20 are in close proximity in the network 100, 
because the nodes 10 and 20 have similar distances to the global landmark nodes GL1 and 
GL2. These types of inaccuracies are known as false clustering. By accounting for the 
distances to the local landmark nodes LL1-LL4, false clustering is minimized and a more 
accurate estimation of the location of the nodes 10 and 20 is determined. 

The network 100 may include many local landmark nodes and global landmark nodes, 
not shown. The number of nodes selected to be local landmark nodes and global landmark 
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nodes is generally much smaller than the total number of nodes in the network. Also, the 
total number of global landmark nodes in the network 100 is generally smaller than the 
number of local landmark nodes. The number of global and local landmark nodes used in the 
network 100 may depend on the desired accuracy of the location information. Simulations 
have shown that a relatively small number of global landmarks are needed, for example, 1 5 
global landmark nodes for a network of 10,000 nodes, to generate accurate location 
information. Almost any node in the network 100 may be chosen to be a global landmark 
node or a local landmark node. For example, a predetermined number of nodes in the 
network may be randomly selected to be global landmark nodes and local landmark nodes, 
whereby the number of global landmark nodes is smaller than the number of local landmark 
nodes. To minimize network traffic local landmark nodes may be strategically placed in the 
network 1 00, such as near gateway routers. For example, nodes near gateway routers may be 
selected to be local landmark nodes. 

As described above, the nodes 10 and 20 measure distance to local landmark nodes 
proximally located to the nodes 10 and 20. In one embodiment, local landmark nodes are 
proximally located to a node if the local landmark nodes are on a routing path to a global 
node. For example, node 1 0 transmits a probe packet to the global landmark node GL 1 . The 
probe packet encounters local landmark node LL1, because it is on the routing path Rl to the 
global landmark node GL1 . The local landmark node LL1 transmits and acknowledge (ACK) 
message back to the node 10. The node 10 determines distance to the local landmark node 
LL1, for example, using the RTT of the probe packet and the ACK message. Also, to 
minimize network traffic, a probe packet may keep track of the number of local landmark 
nodes that it has encountered, for example, by updating a field in a packet header similar to a 
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time-to-live field. If a local landmark node receives a probe packet that has already 
encountered a predetermined number of local landmark nodes, the local landmark node 
simply forwards the packet without transmitting an ACK message. 

In another embodiment, each of the local landmark nodes measures its distance to 
global landmark nodes to obtain its own landmark vector. These landmark vectors are stored 
in a global information table that is stored in the nodes in the network 100. The global 
information table is queried to identify local landmark nodes in proximity to a node. For 
example, the node 10 queries the global information table to identify local landmark nodes, 
such as the local landmark nodes LL1 and LL4 in proximity with the node 10. This may 
include identifying local landmark nodes having landmark vectors with a predetermined 
similarity to the node 10, wherein the predetermined similarity is related to a distance 
threshold between the node and the landmark node. Then, the node 1 0 determines distance to 
the local landmark nodes LL1 and LL4. Thus, a local landmark node need not be in a routing 
path to a global landmark node to be considered proximally located to the node 10. 

Each node in the network 100 may generate location information, such as 
landmark vectors, by determining distances to the global landmark nodes and proximally 
located local landmark nodes. Each node stores its location information in a global 
information table. Thus, the global information table may include landmark vectors for 
substantially all the nodes in the network. 

According to an embodiment, the global information table is implemented using a 
distributed hash table (DHT) overlay network. DHT overlay networks are logical 
representations of an underlying physical network, such as the network 100, which 
provide, among other types of functionality, data placement, information retrieval, and 
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routing. DHT overlay networks have several desirable properties, such as scalability, 
fault-tolerance, and low management cost. Some examples of DHT overlay networks that 
may be used in the embodiments of the invention include content-addressable-network 
(CAN), PASTRY, CHORD, and expressway routing CAN (eCAN), which is a 
hierarchical version of CAN. The eCAN overlay network is further described in U.S. 
Patent Application Serial Number 10/231,184, entitled, "Expressway Routing Among 
Peers", filed on August 29, 2002, having a common assignee as the present application, 
and is hereby incorporated by reference in its entirety. 

A DHT overlay network provides a hash table abstraction that maps keys to values. 
For example, data is represented in an overlay network as a (key, value) pair, such as 
(K1,V1). Kl is deterministically mapped to a point P in the overlay network using a hash 
function, e.g., P = h(Kl ). An example of a hash function is checksum or a space filling curve 
when hashing to spaces of different dimensions. The key value pair (Kl, VI) is then stored at 
the point P in the overlay network, i.e., at the node owning the zone where point P lies. The 
same hash function is used to retrieve data. The hash function is also used for retrieving data 
from the DHT overlay network. For example, the hash function is used to calculate the point 
P from Kl . Then the data is retrieved from the point P. 

In one example, the global information table is stored in a CAN overlay network, 
however other types of DHT overlay networks may be used. In this example, a landmark 
vector or a portion of the landmark vector for a node is used as a key to identify a location in 
the DHT overlay network for storing information about the node. By using the landmark 
vector as a key, information about nodes physically close to each other in the underlying 
physical network are stored close to each other in the DHT overlay network, resulting in a 
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minimal amount of traffic being generated when identifying a set of nodes close to a given 
node in the network. 

Figure 2 illustrates an example of a 2-dimensional CAN overlay network 200 shown 
in figure 2, which is a logical representation of the underlying physical network 100. The 
5 nodes 30-50 shown in figure 2 are not shown in the network 100 shown in figure 1, but the 
nodes 30-50 may also be in the network 100. A CAN overlay network logically represents 
the underlying physical network using a d-dimensional Cartesian coordinate space on a d- 
torus. Figure 2 illustrates a 2-dimensional [0,1] x [0,1] Cartesian coordinate space in the 
overlay network 200. The coordinates for the zones 2 1 0-2 1 4 are shown. The Cartesian space 

10 is partitioned into CAN zones 2 10-2 14 owned by nodes 10-50, respectively. Each DHT node 
in the overlay network owns a zone. The nodes 30 and 20 are neighbor nodes to the node 1 0 
and the nodes 40-50 and 10 are neighbor nodes to the node 20. Two nodes are neighbors if 
their zones overlap along d-1 dimensions and abut along one dimension. For example, the 
zones 210 and 214 abut along [0, .5] x [.5, 0]. The zones 210 and 213 are not neighbor zones 

15 because these zones do not abut along a dimension. 

The nodes 10-50 each maintain a coordinate routing table that may include the IP 
address and the zone coordinates in the overlay network of each of its immediate neighbors. 
The routing table is used for routing from a source node to a destination node through 
neighboring nodes in the DHT overlay network 200. Assume the node 20 is retrieving data 

20 from a point P in the zone 2 1 4 owned by the node 30. Because the point P is not in the zone 
21 lor any of the neighboring zones of the zone 21 1, the request for data is routed through a 
neighboring zone, such as the zone 213 owned by the node 40 to the node 30 owning the zone 
214 where point P lies to retrieve the data. Thus, a CAN message includes destination 
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coordinates, such as the coordinates for the point P determined using the hash function, for 
routing. 

The global information table includes information about the nodes in the network 1 00, 
and the information is stored in the nodes in the DHT overlay network 200. To store 
information about a node in the global information table, the landmark vector for the node, 
which includes distances to the global landmark nodes in the network and distances to 
proximally located local landmark nodes, is used as a key to identify a location in the DHT 
overlay network for storing information about the node. By using the landmark vector or a 
portion of the landmark vector, such as the distances to the global landmark nodes, as a key, 
information about nodes physically close to each other in the network are stored close to each 
other in the DHT overlay network. Figure 3 illustrates a landmark space 300 including 
landmark vectors 310 and 320 for the nodes 1 0 and 20. The landmark space 300 is a logical 
representation of a space for mapping the landmark vectors of the nodes in the network 100. 
The landmark space 300 is being shown to illustrate the mapping of the landmark vectors to 
locations in the DHT overlay network 200 for storing information in the global information 
table. 

The global landmark portions of the landmark vectors for the nodes 10 and 20 are 
used to identify points in the landmark space 300 that are mapped to the DHT overlay 
network 100 for storing information in the global information table. The global landmark 
portion for the nodes 10 is <d(n, GL1), d(n, GL2))>, where d is distance to the global 
landmark nodes and n is the node 1 0 or 20. Each node in the network 1 00 may be mapped to 
the landmark space using the global landmark portion of the respective landmark vector. 
Also, the landmark space 300 may be much greater than two dimensions. The number of 
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dimensions may be equal to the number of global landmark nodes used in the network 100. 
The nodes 10 and 20 are positioned in the landmark space 300 at coordinates based on their 
landmark vectors. Thus, nodes close to each other in the landmark space 300 are close in the 
physical network 100. 

A hash function is used to translate physical node location information (e.g., landmark 
vectors) from the landmark space 300 to the overlay network 200, such that points close in 
the landmark space 300 are mapped to points that are close in the DHT overlay network 200. 
Figure 4 illustrates using a hash function to translate the points for the nodes 1 0 and 20 in the 
landmark space 300 to the overlay network 200. The hash function is used to determine the 
points 10' and 20' in the overlay network 200 that correspond to the points in the landmark 
space 300 for the nodes 10 and 20. The information for the nodes 10 and 20 is stored in the 
nodes that own the zone where the points 10' and 20' are located. Thus, by hashing the 
global landmark portion of a landmark vector, a node in the overlay network 200 is identified 
for storing information in the global information table, such as the complete landmark vector 
and other information associated with the nodes. Thus, the global information table is stored 
among the nodes in the DHT overlay network 200. Using a DHT overlay network to store 
landmark vectors is further described in U. S. Patent Application Serial Number 1 0/666,62 1 , 
entitled "Utilizing Proximity Information in an Overlay Network" by Tang et al., having a 
common assignee with the present application, which is hereby incorporated by reference in 
its entirety. 

In certain instances, the number of dimensions of the landmark space may be larger 
than the number of dimensions of the overlay network. A hash function comprising a space 
filling curve may be used to map points from the larger dimension space to the smaller 
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dimension space, which is also described in the aforementioned patent application, U. S. 
Patent Application Serial Number 10/666,621, incorporated by reference. 

Figure 5 illustrates a flow chart of a method for determining location information 
for nodes, according to an embodiment. Figure 5 is described with respect to the network 
100 shown in figure 1 and the overlay network 200 shown in figure 2 by way of example 
and not limitation. At step 501, the node 10 determines distances to the global landmark 
nodes in the network 100. For example, the node 10 measures distances to the global 
landmark nodes GL1 and GL2 using RTT or another network metric. 

At step 502, the node 10 determines distances to local landmark nodes in 
proximity to the node 10. This may include the local landmark nodes LL1 and LL4 
encountered by a probe packet measuring RTTs to the global landmark nodes GL1 and 
GL2. In another example, distances to all local landmark nodes within a predetermined 
distance to the node are determined using the global information table. This may be 
determined by comparing landmark vectors for nodes. Nodes with landmark vectors 
having a predetermined similarity are selected from the global information table. 

Steps 501 and 502 may be performed together. For example, when the local 
landmark nodes reside on the routing path, probing the global landmark node gets the 
distances to the corresponding local landmarks with substantially no messaging overhead. 
For example, substantially all the routers in the network may be selected as local 
landmark nodes and traceroute or another similar network utility is used to obtain the 
distances to global and local landmark nodes. In this example, distance to every router in 
a routing path between a node and a global landmark node may not be measured. For 
example, a time-to-live field may be utilized, such that distances to only the first 
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predetermined number of routers receiving the probe packet are measured. Alternatively, 
distances to, for example, the 1 st , 2 nd , 4 th , 8 th , and 16 th routers are measured. Thus, 
distances to a number of routers less than the total number of routers on a routing path to a 
global landmark node may be measured. 

At step 503, location information for the node 10 is generated using the distances 
to the global landmark nodes and the local landmark nodes. For example, a landmark 
vector is generated for the node 10 including the distances to the global landmark nodes 
GL1 and GL2 and the distances to the local landmark nodes LL1 and LL4. 

At step 504, the node 10 stores its location information, such as its landmark 
vector, in the global information table. In one example, this includes hashing the global 
landmark portion of the landmark vector to identify a location in the DHT overlay 
network 200, shown in figure 2, for storing the location information and possibly other 
information about the node 10. The other information may include information about 
network metrics associated with the node, such as, forwarding capacity, etc. Also, if the 
node is providing content or services, that information may be stored in the global 
information table. 

Figure 6 illustrates a peer-to-peer (P2P) communications model that may be used 
by the underlying physical network, such as the networks 100 and 500 shown in figures 1 
and 5, according to an embodiment of the invention. P2P networks are commonly used as 
the underlying physical network for DHT overlay networks, such as the CAN DHT 
overlay network 200 shown in figure 2. A P2P network 600 includes a plurality of nodes 
610a. ..61 On functioning as peers in a P2P system. The nodes 610a... 61 On exchange 
information among themselves and with other network nodes over a network 620. The 
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nodes 610a. ..610n may also determine which nodes 610a.. .610n perform other functions 
of a peer in a P2P system, such as object search and retrieval, object placement, storing 
and maintaining the global information table. Objects may include files, URLs, etc. The 
nodes 6 10a... 61 On may be computer systems (e.g., personal digital assistants, laptop 
5 computers, workstations, servers, and other similar devices) that have a network interface. 
The nodes 610a. . .61 On may be further operable to execute one or more software 
applications (not shown) that include the capability to share information (e.g., data, 
applications, etc.) in a P2P manner and the capability to operate as nodes in a DHT 
overlay network. Not every node in the network 600 may be a DHT node (e.g., a node 
10 owning a zone in the DHT overlay network), but substantially every node in the network 
600 may store information in the global information table implemented in the DHT 
overlay network. 

The network 620 may be operable to provide a communication channel among the 
nodes 6 10a... 61 On. The network 620 may be implemented as a local area network, wide 
15 area network or combination thereof. The network 620 may implement wired protocols, 
such as Ethernet, token ring, etc., wireless protocols, such as Cellular Digital Packet Data, 
Mobitex, IEEE 802.11b, Bluetooth, Wireless Application Protocol, Global System for 
Mobiles, etc., or combination thereof. 

Some of the information that may be stored in the nodes 610a. . .n is shown for 
20 node 610a. The node 610a stores a routing table 631, the global information table 632, 
and possibly measured network metrics associated with node, shown as QoS 
characteristics 633. 
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Figure 7 illustrates an exemplary block diagram of a computer system 700 that 
may be used as a node in the P2P network 600 shown in figure 6. The computer system 
700 includes one or more processors, such as processor 702, providing an execution 
platform for executing software. 
5 Commands and data from the processor 702 are communicated over a 

communication bus 704. The computer system 700 also includes a main memory 706, 
such as a Random Access Memory (RAM), where software may be executed during 
runtime, and a secondary memory 708. The secondary memory 708 includes, for 
example, a hard disk drive 710 and/or a removable storage drive 712, representing a 

10 floppy diskette drive, a magnetic tape drive, a compact disk drive, etc., or a nonvolatile 
memory where a copy of the software may be stored. The secondary memory 708 may 
also include ROM (read only memory), EPROM (erasable, programmable ROM), 
EEPROM (electrically erasable, programmable ROM). In addition to software, routing 
tables, the global information table, and measured network metrics associated with the 

15 node, such as QoS characteristics including load, forwarding capacity, bandwidth, etc., 

may be stored in the main memory 706 and/or the secondary memory 708. The removable 
storage drive 712 reads from and/or writes to a removable storage unit 714 in a well- 
known manner. 

A user interfaces with the computer system 700 with one or more input devices 
20 708, such as a keyboard, a mouse, a stylus, and the like. The display adaptor 722 

interfaces with the communication bus 704 and the display 720 and receives display data 
from the processor 702 and converts the display data into display commands for the 
display 720. A network interface 730 is provided for communicating with other nodes via 
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the network 620 shown in figure 6. Also, sensors 732 are provided for measuring QoS 
characteristics for the node, which may include forward capacity, load, bandwidth, etc. 

One or more of the steps of the method 500 may be implemented as software 
embedded on a computer readable medium, such as the memory 706 and/or 708, and 
executed on the computer system 700. The steps may be embodied by a computer 
program, which may exist in a variety of forms both active and inactive. For example, 
they may exist as software program(s) comprised of program instructions in source code, 
object code, executable code or other formats for performing some of the steps. Any of the 
above may be embodied on a computer readable medium, which include storage devices 
and signals, in compressed or uncompressed form. 

Examples of suitable computer readable storage devices include conventional 
computer system RAM (random access memory), ROM (read only memory), EPROM 
(erasable, programmable ROM), EEPROM (electrically erasable, programmable ROM), 
and magnetic or optical disks or tapes. Examples of computer readable signals, whether 
modulated using a carrier or not, are signals that a computer system hosting or running the 
computer program may be configured to access, including signals downloaded through the 
Internet or other networks. Concrete examples of the foregoing include distribution of the 
programs on a CD ROM or via Internet download. In a sense, the Internet itself, as an 
abstract entity, is a computer readable medium. The same is true of computer networks in 
general. It is therefore to be understood that those functions enumerated below may be 
performed by any electronic device capable of executing the above-described functions. 

Some example of the steps that may be performed by the software may include 
steps for determining distances to generate location information. For example, the 
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software instructs the processor 702 to use other hardware for generating probe packets for 
measuring RTT to global landmark nodes to determine distance. In another example, the 
software may generate a request to the global information table for identifying local 
landmark nodes within a predetermined proximity and measure distances to those local 
landmark nodes. The software includes instructions for implementing the DHT overlay 
network and for storing information to the global information table in the DHT overlay 
network by hashing a landmark vector. 

It will be readily apparent to one of ordinary skill in the art that other steps 
described herein may be performed by the software. For example, if the computer system 
700 is selected as a local landmark node, the computer system 700 may respond to 
received probe packets by generating an ACK message transmitted back to a node. Thus, 
the node transmitting the probe packet is able to determine distances to proximally located 
landmark nodes. 

While the invention has been described with reference to the exemplary 
embodiments thereof, those skilled in the art will be able to make various modifications to 
the described embodiments without departing from the true spirit and scope. For 
example, it will be apparent to one of ordinary skill in the art that the advantages of 
storing location information as described herein can be applied to many applications, such 
as information storage, load balancing, congestion control, meeting quality of service 
(QoS) guarantee, taking advantage of heterogeneity in storage capacity and forwarding 
capacity, etc. The terms and descriptions used herein are set forth by way of illustration 
only and are not meant as limitations. In particular, although the method has been 
described by examples, the steps of the method may be performed in a different order than 
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illustrated or simultaneously. Those skilled in the art will recognize that these and other 
variations are possible within the spirit and scope as defined in the following claims and 
their equivalents. 
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